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❖ Game Overview 

❖ Combat NPC Overview 

❖ Design Philosophy 

❖ Archetypes 

❖ Factions 

❖ Challenge Scaling 

❖ Behavior Tree Structure 
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Combat NPC Overview 


■ 36 unique combat Al split into 11 archetypes 

■ 5 enemy factions and 1 friendly faction 

■ Detection system, threat system, scripted control, 
reaction to player Abilities, dynamic objective- 
handling, reactions to civilians and wildlife, idle 
activities 

■ Used in both systemic open world and linear, 
scripted story missions 

■ Behavior Tree architecture 


POWERED BY SDOW jCtfOp 
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RPG AND Shooter 


Strong Archetypes 


Realistic Setting 




Continual Challenge 





RPG AND Shooter 


■ Allow player to play in different ways and 
use various roles 

■ Combine skills and synergize with other 
players 

■ Incorporate typical RPG systems such as 
Aggro and Crowd Control 

■ Incentivize pre-combat setup and tactical 
play 

■ Reward player skill (twitch) 


Design Philosophy 
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Realistic Setting 

■ Tom Clancy brand demands "realism" 

■ No magic or (too) sci-fi tech 

■ Open world allows player to go anywhere at 
any time 

■ Fun is still paramount (fun > "intelligence") 




Design Philosophy 
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Strong Archetypes 

■ Various roles that pose different challenges 
to the player 

■ Encourage the player to utilize different 
tactics based on the enemy archetype 
composition 

■ Create clear archetypes through obvious 
signs and feedback to the player 

■ Enemy synergies create interesting combat 
puzzles for the player 


Design Philosophy 
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Continual Challenge 

■ Introduce new concepts and gameplay to 
the player over time 

■ Add or evolve concepts after player mastery 

■ Rollout more advanced variants of and new 
NPC archetypes throughout game 

■ Provide choice of multiple difficulty levels 
for Missions: Normal, Hard, Challenging 


Design Philosophy 
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Assault 
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Tank 


Sniper 


Thrower 


Support 



Leader 


Rusher 


Heavy Weapons 


"Special" 
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Target Prioritization 


Forces player to deal with an 
immediate threat 


Repositioning 


Forcibly moves the player from 
one location to another 
(reactive) 


Minimize Exposure 


Penalizes the player from 
being exposed too long 



Target Ordering 


Challenges the player to 
determine an optimal path for 
defeating enemies 


Positioning 


Encourages the player to move 
to new, often flanking, 
locations (proactive) 


Endurance 


Requires the player to spend a 
great deal of time before 
defeating the enemy 





Archetype Synergies 
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Assault 

Rusher 

Sniper 

Thrower 

Controller 

/Mech 

Heavy 

Weapons 

Tank 

Leader 

Support 

Assault 
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Assault 


■ Basic shooting and use of covers 

■ Provides standard "depth" of battlefield 

■ Synergy with all archetypes 

■ Grunt role within fireteam 


Challenges 


basic accuracy, timing, positioning 




Archetypes 
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Rusher 


■ Runs directly towards the target 

■ Extra-deadly when within close range 

■ Forces the player to defeat the NPC before 
they are too close 


Challenges 


target prioritization, repositioning 




Archetypes 
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Sniper 


■ Long-range 

■ Very accurate 

■ Punishes player if exposed too long 

■ High damage on single target 


Challenges 


minimize exposure 




Archetypes 
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Thrower 


■ Throws grenades or other dangerous AoE 
items 

■ Forces the player out of their current 
position (usually cover) 


Challenges 


repositioning 




Archetypes 
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Controller 


■ Fights through a proxy (e.g. Turret) 

■ Repairs Turret if damaged 

■ Linked to Turret 

Turret 

■ Shoots at exposed enemies 

■ Low accuracy, but high RoF 

■ Can be repaired by Controller 



Challenges 


target ordering, positioning 


Archetypes 
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Heavy Weapons 


■ Suppresses the player with high RoF 

■ Long time between reloads 

■ Forces the player to avoid exposure 


Challenges 


minimize exposure 





Archetypes 
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Tank 


■ Heavy NPC that takes a lot of damage 

■ Generally have high damage output 

■ Long reload times provide combat 
opportunity for player 

■ Weak point exploitation encouraged in 
order to defeat NPC 


Challenges 


minimize exposure, positioning, 
endurance 



Archetypes 
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Leader 


■ Affects behavior of nearby NPCs 

■ Nearby NPCs become very aggressive 


Challenges 


target ordering, repositioning 




Archetypes 
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Support 


■ Assists teammates by healing them during 
combat 

■ Generally defensive in combat 


Challenges 


target ordering, positioning 




Archetypes 
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"Special" 


■ NPCs without strong archetype 

■ Used only in end-game 


Challenges 


various 




Archetypes 
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Rioters 


■ Earliest faction player will encounter 

■ Present introductory challenge to the player 

■ Build strong archetype associations 

■ Disorganized 

■ Unskilled 

■ Low tech 




Factions 
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Cleaners 


■ Second faction player will encounter 

■ Present slightly more advanced challenge to 
the player 

■ Introduce first Controller, Turret, and Tank 
archetypes to the player 

■ Organized 

■ Efficient 

■ Low tech (though higher tech than Rioters) 




Factions 
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Rikers 


■ Third faction the player will encounter 

■ Present more advanced challenge to the 
player 

■ Ruthless and careless (animation) 

■ Semi-coordinated 

■ Medium tech 




Factions 
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Last Man Battalion 


■ Fourth faction player will encounter 

■ Provide advanced challenge 

■ Very organized and tactical 

■ Modern/high tech 

■ Skilled 




Factions 
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Last Man Battalion 
(Tier 2) 

■ Fifth and final faction player will encounter 

■ Intended primarily for end-game 

■ Provide the most advanced and difficult challenge to the 
player 

■ Blending between archetypes (e.g. Thrower and Assault or 
Controller and Support) 

■ Advanced reactions to player skills and actions 

■ Very organized 

■ High tech 

■ Highly skilled 
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Joint Task Force 


■ Friendly faction 

■ Basic in-combat behaviors 

■ Force player to do most of the work in 
combat 

■ Cheerleaders for the player throughout the 
game in both combat and out of combat 

■ Basic interactions with player out of combat 




Factions 
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Faction Tiers 


M 

0 ) 

CO 

k; 


Rioters 


Cleaners 


Rikers 


D 

H- 

H> 

H) 

H- 

o 

c 


Last Man Battalion 


Last Man Battalion 
(Tier 2) 


NPC Challenge Tiers 
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Reaction to Player Skills/Actions 
Movement Speed/Style 
Group Behavior 
Cover Usage 
Skill Usage 
Stagger Resistance 
Suppression Resistance 
Health 
Damage 
Accuracy 




[“] 


Reaction to Player 
Abilities /Actions 
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■ Different profiles to determine reaction to each player Ability (and some actions) 

■ Profile changes based on Faction tier and NPC role (e.g. Normal, Veteran, Elite, Named) 


Dumb 



Default 



Elite 



Tech 


Heavy 



Mech 



NPC Challenge Tiers 


Dumb 


Profile 

■ Used exclusively by the Rioters 

■ Allows player to be a bit less careful and 
skilled with their Abilities and actions 


Elite 


r 


Profile 


■ Used by Elite role and Last Man Battalion 
(Tier 2) NPCs 

■ Counters some player Abilities and actions 



Reaction to Player 
Abilities 


Default 

A 


Profile 
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■ Used by majority of NPCs 

■ Reacts to Abilities and actions, but does 
not counter them effectively 


Tech 

A 


Profile 


■ Used by Agents and some Bosses 

■ Counters (hacks) many of the player's Abilities and 
actions 


Heavy I 


Profile 


■ Used exclusively by Tank archetypes 

■ Ignores some player Abilities and actions, and counters others in a unique way 
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Turret 


r 


Profile 


■ Used exclusively by Turrets 

■ Ignores player actions, but counters some player Abilities in a unique way 



Reaction to Player 
Abilities 


Movement Speed/Style 


■ Only modified strafe speed of NPCs and 
rush speed of Rusher archetypes 

■ Some "panicked" movement styles were 
swapped with more "composed" movement 
styles 

■ Two different overall cover movement 
styles: 

• Mixed Movement - N PC sprints to a 
location, then strafes while shooting to 
cover 

• Full Strafe - NPC strafes while shooting 
to cover 




NPC Challenge Tiers 
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[-] 


Group Behavior 

■ Two major groups: 

• Disorganized - NPCs do not provide 
cover fire for each other or coordinate 
movement 

• Organized - NPCs provide cover fire for 
each other, coordinate their movement, 
and actively attempt to 
swarm/surround the player 
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H 


Cover Usage 

■ Two major groups: 

• Inconsistent - NPCs have a chance to 
move to a non-cover position and only 
move from it if they're directly being 
shot at 

• Consistent - NPCs always attempt to 
stay in cover; if they are outside of 
cover too long, they aggressively 
attempt to move to cover 




NPC Challenge Tiers 
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Skill Usage 

■ Frequency of Skill usage (grenades, turrets, 
etc.) altered 

■ Modified range, speed of deployment, and 
cooldown of Skills 

■ Swapped out entire Skills depending on 
desired challenge 
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Example: Skill Evolution 
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1 



NPC Challenge Tiers 


Health/Stagger Resistance/ 
Damage /Accuracy 
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■ Health, Damage, Stagger Resistance, 
Suppression Resistance, and Accuracy 
increased in small amounts per faction tier 

■ Stat increases kept to minimum and 
behaviors mostly used instead 




NPC Challenge Tiers 
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NPC Roles 


A 




• Default role of NPCs 


Improved weapons 
Armor added 
Improved aiming 


Other Difficulty 
Modifiers 
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Improved weapons 
Special ammo types 
Laser sights 
(cosmetic) 

Skill modifications 
Improved player 
ability reactions 
Additional Armor 
Improved aiming 


Boss NPCs 

Unique weapons and 
weapon mods 
Additional Armor 
Improved aiming 
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Decision-Making 

Prioritization 


►J 


High-Priority 

Critical 

Events 




Scripted 

Events 


Faction Tier Modifiers 


Base 

Behavior 


i 


Archetype 

Behavior 


Behavior Tree Structure 
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# Low-Priority 

1 

' Critical j 

1 Objectives 

Events j 

' i 


Archetype 

Modification 




States/ 

State 

Transitions 



▼ 


NPC Behaviors 


Combat Encounters 
Behavior Systems 

- Sensory/Detection 
Positioning 

- Threat 

Giving Control to Level Designers 
Cross Discipline Teams 




i- 

i 






Combat Encounters 


Open-World 

• Emergent behaviors 

• Roamer mobs 

• Placed encounters 


Encounters 
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• Authored, linear series 
of encounters 
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Player Investigation Phase 


Allow the player to: 

Scope out combat area 
Identify high priority targets 
Synchronize with Coop players 
Set up initial combat range 


Detection System ^ 





Detection 


System 
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Idle 

Ready 

Investigation 

Combat 

Combat Investigation 


— Detection gauge +H 



Detection gauge reaches Idle— 


-All hostile targets are dead- 


-Investigation failed- 


* Direct damage 

* Near-miss 

* Skill use 


TT 


Direct engagement leads to combat from any state 


READY -Detection gauge ++► INVESTIGATION —Detection gauge +++-► COMBAT — 


Detection gauge fills too fast for Ready to be triggered- 


-Detection gauge fills too fast for Investigation to be triggered- 


Combat investigation failed— 


COMBAT 

INVESTIGATION 


LKP doesn't update for [X] seconds 
+ no other valid target 


L 



Detection System 


Alertness Level 


Underlying the detection system is the alertness level 

• Affected by audio and visual stimuli. 

• Escalation plans differ by archetype and faction. 


Rioter 


READY INVESTIGATION 



LMB 


IDLE READY INVESTIGATION COMBAT 



0 20 


125 


IBS 


L 


Detection System 
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Visual Stimuli 
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Vision Cones 

• Forward + periphery cones 

• Instant combat cones 

• 360 close awareness 

• Defined per Archetype 

• Combat and non-combat cones 

• Aiming and Non-aiming 

• Modified based on weather 

We also modify the line of sight tests 
when a player is in low cover out of 
combat to allow players to stay hidden 
more easily. 


Detection System ^ 





Audio Stimuli 


Audio Events 

• Sound Type 

• Radius 


Sound Type limits the highest alert level that can be triggered 
Interesting sounds can only trigger Ready 
Suspicious sounds can trigger Investigation but not Combat 
Threatening sounds can trigger Combat 


L 


Detection System 
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Assault Rifle 
Explosion (small) 


Threatening 

Threatening 


40 


25 


Explosion (large) 


Threatening 


50 





Last Known Positions 


Allow players to exploit the NPC Detection System as a 
gameplay mechanic. 

• Players are hidden while repositioning along cover 

• Low profile run when moving from cover to cover 

NPCs remember the last position a hostile was seen 

• Aim At Position 

• Novmesh Position 



Detection System 
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Exploiting Detection 
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Detection System 




Local build 

► 





Score: 29.1 

il. 5: Path cost 

E.Ch Comer cover position (0.0) A 
5.4: Optimal Target distance (26.8) 

D O: Has LoS to Target (required) (O Qjfr 


(Filter on Identifier 


Save/Load Recordings 


Save Recording 


□ Contextual Properties 

^ Game Entity Properties 


Resource Name N/A 
Position x 182.855 


AgentDebug 


Weapon pon_assaultrifle_m4_default_soundvariation_3 


NPCConfig fctem data/j u ice/ai/n pc/l mb_c ommando. mn | 


Humanoid Default 


In Combat 


Melee attack 


Game Debug History 


Draw 

Behavior 

Animation 


I 

I 


I 

I 

I 













Tactical 


Positions 




Positioning System 
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Performance 


D Level 


Filter Entire level 


1 □ Properties 


o 


Manhattan 

6 square kilometers 
800 000 cover positions 
1 500 000 non -cover positions 


Cover positions 

• Cover facing direction 

• Cover height 

• Cover depth 

• Corner or Non-corner 

Non-cover positions 

• 4m spacing 

• Rotated grid 



Position Scoring 


Uses a single "Uber" position evaluator 

• Many parameters to affect the evaluator 

• Exposed to behavior through different nodes 

Parameters from behaviors and NPC configuration 

• distance from search position 

• travel distance 

• min/max/optimal target distance 

• cover versus non-cover 

• flanks hostile target 

• flanking by primary and secondary targets 

• line of sight to target or another point 

• fireteam separation and cohesion 

• death stains 

• navigation path passes too close to hostiles" 



Positioning System 
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Successive Queries 
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Cover position with 
an optimal range 


"\ 


Non-cover position 
with line of sight 


Cover or non-cover 
position without 
line of sight 




Positioning System 




Investigation 




Positioning System 
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Threat System 


Base Threat 

enemy proximity 

enemy cover status 

enemy flanking status 

agent type (Player or NPC) 

is the enemy being targeted by allies 

Action Threat 
firing weapons 
using skills 
damaging the NPC 
damaging the NPC's allies 



Threat System 


.^TDM CL^NCY'5 

THF/MlfieiAkl 
vi v igivn 





[sc] 


▼ 

Giving Control to 
Level Designers 


Visual Scripting 


Nodes can modify: 

• Low Level Orders 

• Alert Levels 

• Positioning 

• Threat System 

• High Level Objectives 




LD Tools 
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Blow up the barrels 




Low Level Orders 


NPC Orders 


Move to Position 
Move to Agent 
Take Cover 
Follow Agent 




NPC Orders 
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Used for control of a single NPC in a scripted encounter, 
e.g. Putting a hostage behind cover. 

NPC follow a player. 

Implemented in behavior as critical events. 

• Higher priority than core behaviors. 

• Allows the NPC to respond to grenades or player skills. 




NPC Orders are Trouble 
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Orders skip the evaluation of the underlying systems 
Sensory and Detection 
Threat evaluation 

Orders break NPC reactivity. 

Orders don't provide context for following behaviors. 
An example: A move order that is interrupted by combat 



Low level orders force Level Designers to create All 




NPC Orders 


Combat Positioning 
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Provide Level Designers with modifiers to the position system: 

• NPC Zones 

• Only accept positions within the volume. 

• If NPCs are out of the zone, score positions closer to the zone higher. 

• Tactical Position Modifier 

• Gives score bonus to positions close to the volume with maximum bonus for positions inside the volume. 


Can limit both volume types to particular archetypes 

• Force snipers to stay in specific locations. 




Positioning 


Scripted Alert Levels 


Idle 

Ready 

Investigation 

Combat 

Combat Investigation 
Scripted Investigation 
Scripted Combat 
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Scripted Investigation 

• Provides an area for the NPC to investigate. 

• NPCs don't return to idle. 

Scripted Combat 

• Used without a hostile target. 

• Level Designers can specify one or more threat directions. 

• Skips initial combat behavior - combat reactions and barks. 

• Won't transition to Combat Investigation or Idle. 



Alert Levels 




High Level Objectives 
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NPC Objectives 


Attack Volume 
Attack Player/NPC 
Destroy Prop 
Defend Volume 
Defend Player/NPC/Prop 
Interact with Prop 


Built on top of the underlying NPC systems. 

• Modify detection, positioning and threat systems. 

Primary behavior implemented as slightly lower priority than NPC 
Orders. 

Throughout the behavior tree, NPC Objectives can provide 
additional context for behaviors, including animations and NPC 
barks. 

Affect both in-combat and out-of-combat behaviors. 


L 



NPC Objectives 



Interact with Prop 
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Positioning 


Increase the score of positions near the object. 

Further increase the score of positions between the 
object and hostile threats. 


r 

Threat 


Increase the threat value of hostiles near the object 

Further increase the threat value of any hostiles 
targeting NPCs interacting with the object. 


r 

Behaviors 

l 


I * Move NPCs to the area if they are a long way away 

• If there are no high value threats, move to the object 
and begin interaction. 


L 



NPC Objectives 


Orders vs Systemic 
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We needed both! 

In the open world, prefer systemic behaviors 

• Handles unpredictable player movement 

Low level orders work great in story missions 

• Provides fine level control over agent positioning 

• Better for scripted action sequences than animation sequences. 

Players will find a way to break all NPC behaviors; and low level orders are more brittle. 




LD Tools 


Cross Discipline 
Teams 


Communication 
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Building two-way communication bridges. 


Bugs/Features 



Wikis and email are insufficient. 

Cross Discipline task forces targeting specific elements of the game. 

Weekly sync meetings between Level Designers, NPC designers and Al programmers. 
Embedded a Level Designer within the NPC team. 





Level Design 


Validation and Debugging Tools 
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• Validate as much as possible in the editor. 

e.g. Check that volumes contain enough tactical positions 

• Test levels 

• Reproducing problems 

• Providing examples of intended use 

• Expose your internal debug draw 

• Will be used by some Level Designers. 

• BT debugger was almost never used by Level Designers. 






Level Design 


Conclusion 
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